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We study the synchronous dynamics of the Hopfield model when a random antisymmetric part 
is added to the otherwise symmetric synaptic matrix. We use a generating functional technique to 
, derive analytical expressions for the order parameters at the first time step (t = 1) and the second 

time step (£ = 2). We find that the overlap between the target pattern and the state of the network 
' at t = 1 is independent of the symmetry of the additional random part of the synaptic interaction 

matrix. The result may have bearing on the theories which use the results at t = 1 to estimate 
quantities relevant to the retrieval performance of the network. The symmetry of the synaptic 
interaction matrix becomes effective from the second time step, explicitly through a correlation 
function involving spin configurations at different times. This suggests that the prediction of the 
[ — , long time behavior of the network from the first few time steps may not be always correct. This 

was confirmed by the numerical simulation which shows that the difference in the long time and the 
short time behavior of the network becomes pronounced in presence of asymmetry in the synaptic 
interaction matrix. It is also found in simulations that the size of the basins of attraction of the 
stored patterns decreases with an increase in the asymmetry. Moreover, the convergence time for the 
' retrieval increases. These results are contrary to the expectations from the earlier studies based on 

the counting of fixed points. However, the convergence time for the spurious fixed points increases 
faster than that for the retrieval fixed points in the presence of asymmetry in the synapses. This is 
a positive feature of the asymmetry so far as the retrieval performance of the network is concerned. 
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I. INTRODUCTION 



Theoretical analyzes of neural network models of associative memory using the techniques of statistical physics, 
■ particulary the ones pertaining to the area of spin-glasses have contributed enormously to the understanding of these 
models [2- Q ■ The most widely analyzed model of this kind is the one proposed by Hopfield 0, || . In the Hopfield 
t-h , model, a set of random binary patterns ("memories") are stored in a network using the modified Hebb rule which 
leads to a symmetric matrix of synaptic interactions. While the assumption of symmetry of the synaptic interaction 
matrix enables us to use the well developed analytical tools of the equilibrium statistical mechanics, it is known [f| 
£Q ■ to be biologically unrealistic. 

Furthermore, studies on models of spin glasses and neural networks suggest that presence of asymmetry of an 



appropriate magnitude in the synaptic interaction matrix may result in the improvement of the performance of the 
network as an associative memory (see Refs. @,IU for a detailed discussion on this aspect). It is well-known pj that 
the Hopfield model has a large number of spurious fixed-point attractors which are not strongly correlated with any 
one of the memories stored in the network. The presence of these attractors adversely affects the performance of 
the network by "trapping" initial configurations which are not close to one of the memory states. This problem is 
aggravated by the fact that the network can not, in any way, distinguish between successful retrieval of a memory and 
convergence to a spurious fixed point because in both cases it settles down to a time- independent state. The presence of 
asymmetry in the interactions is believed to alleviate this problem in two different ways. First, analytic and numerical 
studies 0, U ITof have shown that the introduction of asymmetry greatly reduces the number of spurious fixed-point 
attractors while leaving the attractors corresponding to memory states largely unaffected. These results suggest that 
the basins of attraction of the memory states may be enlarged by the introduction of asymmetry. Second, there 
are indications that the presence of asymmetry greatly increases the time of convergence to spurious attractors 
relative to that for convergence to memory states. Thus it may be possible to discriminate between the actual retrieval 
of a stored pattern and a spurious retrieval through the dynamical behavior of the network which has an asymmetry 
in the synaptic matrix. This has been confirmed in the numerical simulations on the Hopfield model with sequential 
dynamics [8j- It is also worth mentioning here that the non-equilibrium dynamics of such models can exhibit the 
features similar to those observed in the glassy systems, which constitute an area of current research [T^ . 
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In this paper, we describe the results of an analytical study which may be relevant to the understanding of retrieval 
properties of a Hopfield-like model in which a random antisymmetric component is added to the symmetric, Hebbian 
synaptic matrix. In a sense this study complements our earlier studies on the same model 0,0. Further, it may be 
useful in developing an analytical technique to study the dynamics of the model, which remains an open problem. 
The major challenge before a reasonable description of the dynamical behavior is to properly account for the noise 
term in the local field arising due to the extensive loading of the memory. The presence of asymmetry in the synaptic 
interaction matrix makes the task further complicated. 

In some of the simple phenomenological theories, for example, in Refs. |l3lll4|. the noise term is assumed to have 
a Gaussian distribution. However, this assumption is shown to have very limited validity 0, 0, 0, . Although a 
dynamical replica theory [l6l Il7j has been used to study the dynamics of the Hopfield model at finite time scales, it 
is not clear whether it can be extended to the asymmetric Hopfield model considered here. 

We have used a generating functional technique to analyze the synchronous dynamics of the asymmetric Hopfield 
model. This technique has been applied to study the synchronous dynamics of the (symmetric) Hopfield model [l8| . 
It is exact in the thermodynamic limit. The choice of the synchronous dynamics is because of its amenability to the 
generating functional method. However, most of the results are expected to hold true for the asynchronous dynamics 
too. Although the generating functional formalism can be used, at least in principle, to calculate the properties of 
the network after an arbitrary number of time steps. There is a major problem in implementing the procedure for 
larger time steps - the number of order parameters increase very quickly with time. We, therefore, restrict ourselves 
here to the analytic expressions for the overlap with a stored pattern after one and two time steps. 

We find that the overlap (between the target pattern and the state of the network) after one time step to be 
independent of the symmetry of the additional random part of the synaptic interaction matrix. So far as the overlap 
after one time step is concerned the additional random part of the synaptic matrix acts just like a noise which goes with 
the noise term which results from the extensive loading of the memory. Symmetry of the synaptic matrix, however, 
comes into picture when we calculate the overlap after two time steps. In this the information of the symmetry of 
the additional random part of the synaptic matrix comes explicitly through an order parameter which involves the 
correlation between the neuron configurations at different times. Similar result has also been reported |l9j| for a 
one-pattern model of associative memory. This feature makes the dynamics of the asymmetric Hopfield model quite 
different from that of the usual Hopfield model. In the usual Hopfield model dynamics is often described approximately 
in terms of the recurrence relations based on the expression of the overlap after single time step. This has also been 
used to compute successfully the basin of attraction, the rate of convergence and the amount of error-correction of 
the model pol l2l| . Obviously, such approximate schemes will not generally hold good for the asymmetric Hopfield 
model. 

We have checked the results of the analytical calculation by carrying out numerical simulation for a network of 
500 neurons. We find that the result of the analytical calculation for the overlap after one and two time steps, m\ 
and m\, agrees very well with that obtained by the numerical simulation. Values of both m\ and decrease with 
an increase in the asymmetry in the synapses. This is true for the value of overlap at large times too. Thus the 
retrieval quality undergoes degradation with the asymmetry. This is consistent with the conclusion drawn from the 
properties of the fixed point attractors in Ref. Q. We also find that the overlap m\ is not always a monotonic 
function of time. For smaller values of the initial overlap m?, ra\ increases with time for first few time ste ps and 
decreases thereafter to converge to its asymptotic limit mf. The similar behavior has been reported in Ref. [18j for 
the synchronous dynamics of the Hopfield model. However, the introduction of asymmetry makes the difference in 
the long time and the short time behavior of the network much more pronounced. We have also calculated in the 
simulation the probability of convergence of the network to a state corresponding to the target memory and that to a 
spurious attractor. The corresponding average convergence times were also calculated. We find that the probability 
of convergence to the retrieval fixed point decreases with asymmetry while that to the spurious fixed point increases. 
However, as reported for the asynchronous dynamics of the same model the convergence time for the spurious 
fixed points increases faster than that for the retrieval fixed point in presence of asymmetry in the synapses. This 
behavior may be quite useful in providing a way to discriminate the correct retrieval from a spurious one. 

The paper is organized as follows. In Section^ we describe the generating functional technique and obtain the 
analytic expressions for the order parameters after one and two time steps. We discuss the results in Section ITTT1 The 
paper is concluded in Section IIVI The technical details of the derivations are presented in Appendices El an( l [El 
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II. GENERATING FUNCTIONAL METHOD 



We consider a system of N neurons ("spins") {<7i}, each of which can take values +1 or — 1. The synaptic interaction 
matrix, which describes how neuron i affects the state of neuron j, is defined as 



Jij = Jfj + /-•./;'; for i ^ j 

= for i = j . 



(1) 



Jfj which describes the symmetric part of the synaptic matrix is given by the modified Hebb's rule in terms of the 
stored patterns {£f }, /z = 1, . . . ,p 



1 p 

— f^F^ 



(2) 



Here, each £f may take values ±1 with equal probability. The number of stored patterns in the network is p, and 
a = p/N is the memory loading of the network. The elements of the antisymmetric part Jf^ of the synaptic matrix 
are drawn randomly from a Gaussian distribution with zero mean and variance 1 / yN, that is, 



P(J!f) 



1 



exp 



2/N 



i < j, 



(3) 



and Jf* — —Jjf- The parameter k is a measure of the strength of the antisymmetric part of the coupling relative to 
that of the symmetric part. The synchronous dynamics of the system is given by the rule 



4 =sgn^Jy<r* ^ 



(4) 



where all the spins are updated at the same time. The dynamics of the system can be described by the following 
generating functional |18| for the average spin-spin correlation function 



V{h tlt2 ) = ( Tr' W} Tr K} {[ f[ 9 ( a\ £ Jytrf 1 I exp ( ]T h tlt2 £ a**aA 

\ t=l,...,T i=lt=l \ j=l I \ tl t 2 t ) 



(5) 



where (• • • indicates and average over the realizations of the synaptic interaction matrix {Jij}. The trace, Tr'^oi 

over the initial spin configuration is restricted to 



-H l<i< Ng, 
Ng < i < N, 



(6) 



so that it has overlap 1 — 2g with the /i = 1 pattern. Using the integral representation for the ^-function, y can be 
expressed as 



y(h tlt 



(rr[ a( , } Tr K} exp ^ h tlt2 £ ofo* J I] [jf ^ jH fj 

exp i ^ A*x* - i A u\ o]r- x 



(7) 



i,j,t 



{Jij} 



For the synaptic matrix considered here we have 



exp — i x\ o\ J, L j a 

i,j,t 



1-1 
J 



X Y, 



(8) 
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where X and Y contain averages over the symmetric part (stored patterns) and the antisymmetric part of the synaptic 
interaction matrix, respectively. These are given by 



X = ( exp 



V 



J 



(9) 



In order to carry out the average over the stored patterns it is convenient to define variables 



TO, 



(10) 



(11) 



and their conjugates 1 through the identity 



fi,t 



/°° f°° an ( 

N dm*- 1 J -g- exp I iNn*- 1 ™*- 1 - m^" 1 ]T a'" 1 ^ 



so that X becomes, 



JVdm*- 1 ^*- 1 

M P 

2tt 



exp \iNj2 n l lm l 1 + ia J2 x i a i a i 1 



fj,,t 



(exp (_< x: < 1 e -r 1 ^ - i e e W) ) 



After averaging over the patterns, ji = 2, . . . ,p we get 



/ 



N dm 1 " 1 tin* -1 
2tt 



exp \iNj2 n i lm l 1 + ia J2 x i a i a i 1 



fj,,t 



cx p E E ln - 



cos 



V/j — 2 i 



^xp L y: e ^ - * E "J" 1 E ^) ) 



(12) 



(13) 



(14) 



Since the spin configuration has a finite overlap only with pattern 1, only the first term in the expansion of lncos[ 



contributes to leading order in N. Thus we get 

exp iN E n^m*- 1 + ia E A^H' 1 



X 



Ndm 1 ' 1 dn*- 1 



exp 



2tt 



2 ^ 

H,ta 



Et-,-1 h-iv^ ti-l t 2 -l i ti— 1 ta— 1 ti *2 *i 



.M>1 



Ai>l 



+2E"r l ™r l E^ 1 ^ 1 ^ 2 " 1 



M>1 



'exp (_< E -i" E ^ -*E< _1 E W) ) 



Now 



00 <2J? S 



'JJJ-l J JJ-ll 



, 27V 

Ignoring terms of (D(l/N) we get 



r = cx pi^E ( E^^E^-M 1 " 1 - E^NN? E^'M 



*i,*2 \ i 



Let 



^E^" V * 2_1 =9 tlt2 for tl<iai 

i 



l -Y^^^^^ =P tlt2 for *i<ta. 



Introducing the delta function constraints corresponding to the variables defined above 



i= n 



tl.ta 

tl<*2 



Ndr tlt2 



exp iNr tlt2 q tlt2 - ir tlt2 E f^ 1 " 10 "! 2-1 



tl,*2 

n 



*1,*2 

ii<t 2 



.V ,//,•' 1 i — exp I iNk tlt2 s tlt2 - ik tlt2 E A A °f _1 



J°° Ndl^ t2 J°° ^|^exp ^itf^V 1 * 2 -il^J^xfxfafaf^ , 



and performing average over in accordance with the constraint given by Eq. © we get 

/>oo 

y (h tlt2 ) cx / dm*" 1 dn'f 1 dr tlt2 dq tlt2 dk tlt2 ds tlt2 dl tlt2 dp tlt2 e N F ( mi ' ni 
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where 



F(mi,ni,...,h tl t 2 ) 



t tl<t 2 



tlt 2 



t > r g 

tl<t 2 



+ i 



^ ^v it2 +*E fctlt2s 

tl<«2 *1*2 

+ (1 -g) lnZ+ (ni, mi, r' 1 ' 2 , fc* 1 * 2 , Z* 1 * 2 , &t lta ) 
+ 9 In Z_ (ni , mi , r' 1 * 2 , fc' 1 * 2 , Z' 1 * 2 , h tl ta ) , 



tlta 



(25) 



ir 



T r 



n 



t-i j„t-n 



N dm dn 



2ir 



and 



In the limit N 

are 



-AT ^ [g^n*!- 1 
ti<t 2 



n * 2 -i + pti«2 m ti-i m t 2 -i +s tlt2 m tl- V 2 " 1 l 



i /•CO /*00 

Z ± (ni,mi,r tlt2 ,fc tlt2 ,Z tlt2 > tlt2 )=- Tr CT t / TT [dA*] / TJ 

^t=0,l,...,TJO Joo t= 7 

r T T 

exp < i ^ x* A* + i a ^ a;' cr* cr t_1 + ft tl ta ct* 1 ct* 2 



da;* 
"27 



t=i 



ti t 2 



-i rti t2 ^ - 1 E ktl t2 xtl CTtl o-ta_1 - 1 E ?tl 



* 2 a;' 1 x* 2 ct* 1 fi* 2 



tl<*2 



ti ta 



*i<t 2 



T T 1 

t=i t=i J 



(26) 



(27) 



the integration in Eq. l|2 'l[| can be evaluated by steepest descents. The saddle point equations 



,ti ta 



*i t a 



„ti ta 



ir tlt2 
i fc* 1 * 2 



ti<t 2 



(1-5) 



ti-l „ta-l 



ti-l „ta-l 



= (1 - g) {x^ a' 1 a* 2 - 1 )^ + g (x* 1 a' 1 a 4 - 1 )^ , 
(1 - g) {x l1 x t2 er' 1 a t2 ) z + g (x* 1 a;' 2 cr' 1 er' 2 ) z 



*1<*2 



= (1 - g) {a x^ a^) z+ - g (a x^ a^) z _ , 

- (l- 5 )(aV% + - 5 (aVV, 
k 2 p tlt2 +Na (n tl - 1 n t2 - 1 ) w , 



ti<t 2 



u2 _tl t2 



+ Na (? 



,tl-l„t2-l 



iZ*i* 2 = fc 2 o tlt2 +7Va (to* 1 ^ 1 ??!* 2 " 1 ) 



ti<t 2 



(28) 
(29) 
(30) 

(31) 
(32) 
(33) 

(34) 
(35) 

(36) 



The averages are calculated with ht 1 t 2 = CI- 
As shown in Appendix^ a number of order parameters vanish: 



s tlta _ 
Jti t 2 _ 



for t 1 >t 2 , 

for all ti, t 2 i.e. t\ <t 2 , 

(note that p tx * 2 has been defined for t\ < t% only) 

for all t . 



(37) 
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In addition following correlation functions also vanish: 

(n tl - 1 n t2 - 1 ) w = for h < t 2 , 

and 

{m tl - 1 n t2 - 1 ) w = for h < t 2 . (38) 

Using p tlt2 = we get 

r tlt2 =0. (39) 
In view of these results the non-zero saddle point parameters are given as 



qtl t 2 


ti<t 2 


(1- 


g) (a^a^) z+ +g(a^- 


s tlt 2 


ti<t 2 


(1- 


g) (a;* 1 cr* 1 cr* 2_1 ) z+ + 5 (a:* 1 


m\ 




(1- 


.9) <^% + -.9<-°-%_, 


ik lt 




Na 


fa*" 1 "*" 1 )* 


ik tlt2 


tl>*2 


-k 2 


s* 2tl + 7Va (ffl' 1 " 1 ^ 2 " 1 )^ , 


il tlt2 


ti<fa 


k 2 q l 


lt2 +Na (m tl ' 1 rn t2 ~ 1 ) w , 


il lt 




k 2 


«•»*")%■ 







' Z- ' 



(40) 
(41) 
(42) 
(43) 
(44) 

(45) 
(46) 



Some of the non-zero parameter can be easily interpreted in physical terms. For example, q 1 2 is the overlap between 
spin configurations at time t\ — 1 and t 2 — 1, s' 1 * 2 is related to the overlap of local fields and spins [18j and m\ is the 
overlap between pattern 1 and the spin configuration at time t. Information of symmetry of the additional random 
part of the synaptic interaction matrix is explicitly contained in the order parameter fc* 1 * 2 for t\ ^t 2 . 



III. RESULTS 

We have evaluated explicitly the non-zero order parameters for first two time steps (i.e. t = 1 and 2). Here we 
present only the final result. Technical details of the calculation are given in Appendix [5] The order parameters for 
t = 1 are 

k 11 = a, 

zZ 11 = lia + k 2 ), 

m\ = erf{ - W ° s ) . (47) 

We note that the one step dynamics does not depend on the symmetry of the additional random term to the synaptic 
interaction matrix of the Hopfield model. The additional part acts just like a noise which goes with the noise term 
resulting from the extensive loading of the memory. The new non-zero order parameters after two time steps are 



q 12 = m\m\. 



s 12 = ill — -r- exp 



0\2 



I I 



2 2 



ir(a + k 2 ) 2(a + k 2 ) 

1 1 .OS OL 



2 (a + fc 2 )-|{( S 12 ) 2 + 2z, 12 S 12 } 
il 12 = (a + k 2 )q 12 -it 



; a s 



i 22 

k = a, 

k 21 = -i(a~k 2 )s 12 , 



2\/iX 22 J 2 V 2Vip2 
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As mentioned earlier the generating functional method described above can be used to describe the dynamics of 
the system at any arbitrary time. However, the number of non zero order parameters grows quite fast with time 
and thus calculation becomes difficult. Therefore we have also carried out numerical simulation for a network of 500 
spins to find out the evolution of the overlap, m\, of the system for longer times, for various values of the initial 
overlap, m?. To be specific, we have carried out simulations for t < 80 to ensure that ra\ has more or less converged 
to its asymptotic limit. The memory loading level a was taken to be 0.1. The results have been averaged over 5,000 
and 10,000 realizations of the synaptic interaction matrix for k — and k ^ 0, respectively. This provides a useful 
check on the analytical calculations for first two time steps. Furthermore, it also provides information about the 
long term behavior of the system. Results for to}, and mf° for different values of the initial overlap, to?, and 
the asymmetry parameter, k, are given in Table [I] It can be easily seen that the results of the analytical calculation 

TABLE I: Analytical results for the overlap, m\, obtained from the generating functional technique for t = 1 and t = 2 for 
different values of the initial overlap, m?, and the asymmetry parameter, k. Numbers in the parenthesis are results for the 
overlap for t = 1, 2 and 80, of numerical simulations of a network of 500 neurons and 50 memories. Results of simulations have 
been averaged over 10,000 realizations of the synaptic interaction matrix for the asymmetric network and 5,000 realizations for 
the symmetric network. 





k 


m{ 


m\ 


mf 


0.1 




0.1 
0.2 


0.248 (0.250 ± 0.047 ) 
0.237 (0.239 ± 0.046) 
0.211 (0.211 ±0.045) 


0.248 (0.247 ± 0.078) 
0.243 (0.243 ± 0.079) 
0.229 (0.229 ±0.079) 


(0.131 ± 0.140) 
(0.120 ±0.143) 
(0.009 ±0.146) 


0.2 




0.1 
0.2 


0.473 (0.478 ± 0.052) 
0.453 (0.456 ± 0.049) 
0.407 (0.410 ± 0.044) 


0.491 (0.496 ± 0.084) 
0.480 (0.482 ± 0.082) 
0.447 (0.451 ± 0.078) 


(0.297 ±0.190) 
(0.267 ±0.180) 
(0.194 ±0.160) 


0.3 




0.1 
0.2 


0.657 (0.661 ±0.051) 
0.634 (0.637 ± 0.048) 
0.577 (0.580 ± 0.043) 


0.709 (0.713 ±0.083) 
0.690 (0.694 ± 0.080) 
0.638 (0.642 ± 0.075) 


(0.624 ± 0.305) 
(0.550 ± 0.307) 
(0.348 ± 0.267) 


0.4 




0.1 
0.2 


0.794 (0.797 ± 0.045) 
0.772 (0.776 ± 0.043) 
0.715 (0.717 ±0.039) 


0.867 (0.870 ± 0.064) 
0.846 (0.849 ± 0.064) 
0.786 (0.790 ± 0.063) 


(0.914 ±0.190) 
(0.867 ± 0.235) 
(0.622 ± 0.343) 


0.5 




0.1 
0.2 


0.886 (0.889 ± 0.035) 
0.868 (0.871 ± 0.034) 
0.818 (0.821 ±0.033) 


0.950 (0.951 ±0.035) 
0.934 (0.936 ± 0.040) 
0.883 (0.887 ± 0.046) 


(0.985 ± 0.068) 
(0.969 ±0.105) 
(0.839 ± 0.263) 



for m\ and ml match quite well with those obtained by the numerical simulation. The overlap at any given time 
decreases with increasing k. This becomes more clear in Fig. ^ where we show the evolution of the overlap obtained 
from the numerical simulation for different values of k and to". R is also found that for the values of to? as high as 
0.5, the overlap increases with time initially for first few time steps. Thereafter it starts decreasing before converging 
to its asymptotic limit. This is consistent with the result reported in Ref. for the symmetric network (fc=0), that 
the overlap is not always a monotonic function of time. Thus, the introduction of asymmetry in the synaptic matrix 
does not bring about any qualitative change in this behavior. In fact, it makes it even more pronounced (Fig. 

The effect of asymmetry on the size of the basins of attraction of the stored patterns and the convergence rate was 
also investigated by the numerical simulations. In our simulations of a network of 500 neurons with 50 memories, we 
choose each initial state in such a way that it has a overlap to? with a specific memory state (the target state). The 
total number of initial states used for each value of to? was 20,000 for the asymmetric network and 10,000 for the 
symmetric network. The network was allowed to evolve for a maximum of 200 time steps to look for the fixed points 
of dynamics. Table ITT1 gives the probabilities for the correct retrieval (operationally defined as one in which the overlap 
of the fixed point with the target memory exceeds 0.95) and the spurious retrieval, and the average convergence times 
for these retrievals for different values of to? and k. We find that the probability of convergence to the retrieval fixed 
point decreases with increasing k while that to the spurious fixed point increases. Thus, we do not find increase in 
the size of the basins of attraction of the stored patterns when asymmetry is introduced in the synaptic interaction 
matrix of the Hopfield model. In fact, contrary to the expectations which arise from the calculation of fixed point 
attractors in Ref. |7j , we find reduction in the size of basins of attraction of the stored patterns with the increasing 
asymmetry in the synaptic interaction matrix. Moreover, the convergence time for the correct retrieval also increases. 
However, the convergence time for the spurious fixed points increases much faster than that for the retrieval fixed 
point in presence of asymmetry in the synapses. This is a positive feature of the asymmetry so far as the retrieval 
performance of the network is concerned. It may be quite useful in discriminating the spurious fixed points. 
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FIG. 1: Results of numerical simulations for the evolution of the overlap, m\. N — 500 and a = 0.1. Results have been 
averaged over 10,000 realizations of the synaptic interaction matrix for the asymmetric network and 5,000 realizations for the 
symmetric network. Full curve: k — 0; dotted curve: k — 0.1; dashed curve: k — 0.2. (a) m° = 0.2. (b) m? = 0.3. (c) m? = 0.4 
(d) ml = 0.5. 



IV. SUMMARY AND DISCUSSIONS 



To summarize we have studied the synchronous dynamics of the Hopfield model of associative memory when a 
random antisymmetric part is added to the otherwise symmetric synaptic matrix. A generating functional technique 
was used to derive analytical expressions for the order parameters at t = 1 and 2. We find that the overlap between the 
pattern under retrieval and the state of the network at t = 1 is independent of the symmetry of the additional random 
part of the synaptic interaction matrix. The result may have bearing on the theories which use the results at t = 1 
to estimate quantities relevant to the retrieval performance of the network, namely, the size of basins of attraction of 
the stored patterns, the retrieval quality and the convergence rate. The symmetry of the synaptic interaction matrix 
becomes effective from the second time step, explicitly through a correlation function involving spin configurations 
at different times. This suggests that the prediction of long time behavior of the network from the dynamic behavior 
of the first few time steps may not be always correct. This was confirmed by the numerical simulation which shows 
that the difference in the long time and the short time behavior of the network becomes pronounced in presence of 
asymmetry in the synaptic interaction matrix. It is also found in simulations that the size of basins of attraction of 
the stored patterns decreases with the asymmetry. Moreover, the convergence time for the retrieval increases. These 
results are contrary to the expectations arising from the earlier studies based on the counting of fixed points. However, 
the convergence time for the spurious fixed points increases faster than that for the retrieval fixed point in presence 
of asymmetry in the synapses. This is a positive feature of the asymmetry so far as the retrieval performance of the 
network is concerned. It may be quite useful in finding a way to discriminate the correct retrieval from the spurious 
ones. 
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TABLE II: Probabilities for the correct retrieval, P r (operationally defined as one in which the overlap of the fixed point with 
the target memory exceeds 0.95) and the spurious retrieval, P s , and the average convergence times for these retrievals, (r r ) 
and (r s ), respectively, for different values of and k. The results were obtained by numerical simulations of a network of 500 
neurons and 50 memories. The total number of initial states used for each value of m\ was 20,000 for the asymmetric network 
and 10,000 for the symmetric network. The network was allowed to evolve for a maximum of 200 time steps to look for the 
fixed points of the dynamics. 
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Although the generating functional technique is exact in the thermodynamic limit and can be used, in principle, 
to calculate the properties of the network after an arbitrary number of time steps, the number of order parameters 
increase very quickly with time. Thus for all practical purposes the technique is used to calculate the order parameters 
only for first few time steps. Recently, Koyama et al. |22| have developed an approximate scheme which simplifies 
considerably the calculations of the order parameters for longer times for the synchronous dynamics of the (symmetric) 
Hopfield model. Henkel and Opper [l5| have formulated another approximate framework for the synchronous dynamics 
of neural network models of associative memory within the generating functional theory. Deriving its physical insight 
from another dynamic formation known as the cavity method this consists of approximating the probability 
distribution of the local field by two Gaussian peaks to properly account for the memory effects which arise due to 
the spin correlations at different times. It would be quite interesting to extend the similar analyzes to the asymmetric 
Hopfield model. There exists yet another possibility of formulating a method to study th e dy namics at longer time 
scales within the very framework of generating functional method. Eisffcller and Opper |23l |24| have developed a 
mean field Monte Carlo method for simulating the parallel dynamics of the well known Sherrington-Kirkpatrick (SK) 
[25| model of a spin glass. The method uses the generating functional technique to derive a decoupled set of single spin 
equations which are exact in the thermodynamic limit. A Monte Carlo method is used to generate spin trajectories 
corresponding to the stochastic dynamics of the single spin, which in turn can be used to calculate the averaged 
quantities of interest. This technique has already been extended to study the synchronous dynamics of a one pattern 
model of associative memory [26] . A further generalization of the formalism to the synchronous dynamics of the 
Hopfield model remains an open problem. 

APPENDIX A: DETERMINATION OF THE VANISHING ORDER PARAMETERS 

In this Appendix we show that a number of order parameters, which are solutions of the saddle point equations 
H28f) - I|3tj[) . vanish. It has been shown in Ref . [lg that the the average of the form (x T a T S(x t , c t )) z± vanish, where 

S (x , (7*) depends only on the times earlier than T . 

s* 1 42 = (1 - g) <a* a*i a 42 " 1 )^ + g (x^ a* a^ x ) z _ . 

We note that both of the expectation values in the above equation are of the form (x T a T S(x t , <x*)) for t\ > t% with 
S(x t , a 1 ) — a 1 and thus 

s'i '2=0 for h>t 2 . 
p tlt2 = (1 -g) (x* 1 x t2 ct* 1 a t2 ) z + g (x l1 x t2 a* 1 a t2 ) z _ . 
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Here also the expectation values are of the form (x T a T S(x*, a*)) for t\ < t 2 with S(x t , a*) — o l x l and hence 

p* 1 * 2 = for ti<t 2 . 

For t\ = t 2 = t we have 

P " = (l-g){(xf) z++9 ((xt) 2 ) z _. 

In this case too both the expectation values are zero as we have a term which becomes after taking the trace over a T 

I' T = J~ ' d\ T J°° ^- (x T ) 2 exp{ix T \ T ~il TT (x T f}(f Tc -e-* Tc ) . (Al) 

Once again by making change of variables x T — ► — x T and A T — ► — A T in the second term it can be shown that 

I' T = Q. (A2) 

Therefore 

p" = 0. 

Next we look at the expression for n\ 

n\ = {l-g) {a x t+1 a t+1 ) z+ g (a x^ a t+1 ) z _ . 

Here also the expectation values arc of the form (x T a T S(x t , c*)} with S(x t , a 1 ) — a and hence 

n{ = for all t . 
Using these results we get the following expression for W 



W = 



poo T 

/ n 

Joe t=1 



N dm 1 - 1 dn*- 1 



2tt 



N 



exp UN^n^m^-^in*- 1 ) 



—N q* 1 * 3 n* 1 ' 1 n**- 1 - N ^ s' 1 ^m' 1 " V 2 " 1 1 . 

tl<*2 tl<t 2 J 

Let us now consider any expectation value of the form (n T n t ) w for t < T. It will have a term of the form 

I>+ = / 



(A3) 



N dm T dn T 


T J 




n exp < 


2tt 





T-l 



T-l 



-N n T J2 1 t+h T+1 n* - iV n T ^ S t+1 - T+1 i 



(A4) 



t=o 



t=0 



After performing integration over m T we get 



-Nn T J2 q t+1 ' T+1 n f - iVn T £ s *+ 1 - r + 1 



= 0. 



Hence 



Using similar arguments we get 



t=o 



t=o 



(A5) 



(n* 1 - 1 ^ 2 - 1 )^ = for h<t 2 . 
(m tl ~ 1 n t2 ~ 1 ) w = for h < t 2 . 
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APPENDIX B: CALCULATION OF THE NON-ZERO ORDER PARAMETERS 



In this Appendix we give the results for the order parameters and the overlap up to second time step, obtained 
from the saddle point equations (|40|l - (|46|) . 



1. Order Parameters for t — 1 
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il 1 



Na 



Na(m° n°) w 

Na J^ NdrM n m exp ( lNn m _ |( n 0)2) 
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d_ 

dx 
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dx 
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2tt 



exp I ixn°m° 
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7Vdn°<5(:m )exp ( -y(n ) 2 
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— In — 

9a; x 



-N 
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fc 2 iVa 
Y + ~2 
d 



dx 



■In 



Ndm°dn° 
2V 



exp j iNn°m° - y(n ) 2 



iVa 



2;(to°) : 



f M^ + i)- 1 / 2 

ox 



a 
2 



=^iP = -( a + /c 2 ). 
Substituting the values of k 11 and Z 11 in the expression for Z± in Eq. 127|) 

TW ^ /q 00 rfA 1 g exp {z^A 1 - i(q + fc 2 )^ 1 ) 2 T ^V} 
<fT ff >Z± ~ Tr CT o CTl /~dA 1 /_ 00 00 ^exp{ l xiA 1 -i(a + fc 2 )(a ; 1 ) 2 T*^ mOa ; 1 ( 7 1 } 

Performing the trace we get 



r n °° dx 1 r 

JO J —QO 


dx 1 p zx 1 A 1 — 


i^+fc 2 )^ 1 ) 2 


^fim^x 1 ^^zirn^x 1 


f n °° dA 1 r°° 

JO J — oo 


(ia; 1 ix 1 \ 1 - 
2tt e 


Ka+fe 2 )^ 1 ) 2 


^fim^x 1 _|_ giim^ar 1 ! 
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For the second term in the denominator let x 1 — > — x 1 and A — ► —A so that 



<°V>z ± = 



Jo 



27r(a+*; 2 ) 



-(A 1 T m' i l ) 2 /2(a+fe 2 ) _ c -(A 1 ±m;) 2 /2(«+fe 2 )" 



f°° ^1 f°° da 1 c ix 1 \ 1 -h(a+k 2 )(x 1 ) 2 Tim<l'j 

J — OO J— OO 27T 



erfc ( =F 



V 2 ( Q + fe2 ) 



- erfc ± 



dx 1 S(x)e-^ a+k2 K xl ^ im ° xl 



±erf ±- 



rn 



^2{a + k 2 )) 
I = (l- 5 )(<7V) 2+ - ff (aV) 2 _ 



= erf 



y2(a + fc 2 ) / 



Order Parameters for t = 2 



= (l-9)(aV> z++S ( ff V), 
= (1 - 2.g)m} = m\m\ . 



s 12 = (l-g)(x 1 ) z+ +g(x 1 ) z _ 
In the expressions for the expectation values we have an integral of the form which comes from Z±: 



I = Tr„ 



/ dx2 / 

Jo J-i 



dx 2 
2tt 



-\2 2 -t22/ 2\2 , 2 2/- -, 21 -, 22 1 -,12 1 1 _,_ - 1\ 

3 »A x —it {x ) +x a (ta — tk a —ik a —%l x a ^icr 



First performing the trace over a 2 and making x 2 — > — x 2 and A 2 — > —A 2 in the second term allows us to combine 
both the terms with limit of integration over A 2 from to oo to -oo to oo. Thus, we have 
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it can easily seen that the integration over m° gives 5(n° + is^n 1 ) so that 



ik 22 =Na 



Ndm 1 dn 1 11 iNm 1 n 1 + §(s 12 ) 2 (n L ) 2 -^(n 1 ) 2 +iNa 12 s 12 (n 1 ) 2 
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Integration over m 1 gives ^(xn 1 ) and we get 



^ 22 



TVa 
a . 



— In — 

9x a; 



k=JV 



Now 



zfc 21 = -AV 2 + JV^rnV) 



w 



Proceeding in the same way as in the calculation of fc 22 given above we note that the presence of S(n° + is 12 n 1 ) (which 
appears after performing integration over m°) can be exploited to have 



Na(m n )w — —is Na(m n )w = ols 



,12 



Therefore 



2\„12 



ik 11 = {a-k 2 )s 
or k 21 = (a-k 2 ). 



7r(a + fc 2 )° XP l 2(a + k 2 ) 
In order to calculate I 22 we need to evaluate the following expectation value 
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Here, too, we have used the result that the integration over m° gives 5{n" + is 12 !! 1 ). Now 
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Calculation of ^ 12 requires 
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Integration over m 1 gives Sfa 1 + xam°) and hence 
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Therefore 

il 12 = k 2 q 12 + NaimPm^w = {k 2 + a)q 
Finally we need to calculate the expectation values (a°a 2 )z ± for m\ 



12 ias 12 . 



(a°a 2 ) z , = ±TW«r> / d\ 1 d\ 2 / ^^A 2 exp {jAV -MAV - ^V) 2 - 
2 Jo J-oo 2vr 2?r 

•;22 / ' 2\2 i 21 2 2 -;12 1 2 1 2 _ • 11-^-0 12 21 

— z/ [x ) — ik x a a — il x x a a =F 10 m\x a =F 10 m\x a \ . 
The above expression has an integral 
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Taking trace on a 1 and letting A 1 — > — A 1 and x 1 — » —x 1 in the second term, as before, it is easy to show that 1=1. 
Thus, 
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